On the Rate of Convergence of Infinitehorizon Discounted Optimal

نویسنده

  • Fabian Wirth
چکیده

In this paper we investigate the rate of convergence of the optimal value function of an innnite horizon discounted optimal control problem as the discount rate tends to zero. Using the Integration Theorem for Laplace transformations we provide conditions on averaged functionals along suitable trajectories yielding at most quadratic pointwise convergence. Under appropriate controllability assumptions from this we derive criteria for at most linear uniform convergence on control sets. Applications of these results are given and an example is discussed in which both linear and slower rates of convergence occur.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On linear convergence of discounted optimal control problems

In this paper we investigate the rate of convergence of the optimal value function of an innnite horizon discounted optimal control problem as the discount rate tends to zero. We provide several estimates along trajectories yielding results on the rate of convergence of the corresponding functional. Using appropriate controllability assumptions we derive a linear convergence theorem on control ...

متن کامل

Pareto-optimal Solutions for Multi-objective Optimal Control Problems using Hybrid IWO/PSO Algorithm

Heuristic optimization provides a robust and efficient approach for extracting approximate solutions of multi-objective problems because of their capability to evolve a set of non-dominated solutions distributed along the Pareto frontier. The convergence rate and suitable diversity of solutions are of great importance for multi-objective evolutionary algorithms. The focu...

متن کامل

Computing Time-varying Stability Radii via Discounted Optimal Control

The problem of calculating the maximal Lyapunov exponent of a discrete inclusion (or equivalently its generalized spectral radius) is formulated as an average yield optimal control problem. It is shown that the maximal value of this problem can be approximated by the maximal value of discounted optimal control problems, where for irreducible inclusions the convergence is linear in the discount ...

متن کامل

Convergence of the Value Functions of Discounted Infinite Horizon Optimal Control Problems with Low Discount Rates

For autonomous, nonlinear, smooth optimal control systems on n-dimensional manifolds we investigate the relationship between the discounted and the average yield optimal value of infinite horizon problems. It is shown that the value functions of discounted problems converge to the value function of the average yield problem as the discount rate tends to zero, if there exist approximately optima...

متن کامل

Convergence Results for Some Temporal Difference Methods Based on Least Squares Citation

We consider finite-state Markov decision processes, and prove convergence and rate of convergence results for certain least squares policy evaluation algorithms of the type known as LSPE( ). These are temporal difference methods for constructing a linear function approximation of the cost function of a stationary policy, within the context of infinite-horizon discounted and average cost dynamic...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1998